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CLAIMS: 



northo{n) 

1 . A method of calculating iteration values for free parameters « of a 

maximum-entropy speech model MESM in a speech recognition system with the aid of the 
generalized iterative scaling training algorithm in accordance with the following formula: 



where: 

n : is an iteration parameter; 

G : is a mathematical function; 

10 a : is an attribute in the MESM; and 

^ortho 

« : is a desired orthogonalized boundary value in the MESM for the attribute a, 

characterized in that the desired orthogonalized boxmdary value « is calculated by 

in in 
linearly combining the desired boundary value with desired boundary values ^ of 

attributes (3 that have a larger range than the attribute a. 



ru 15 



2. A method as claimed in claim 1 , characterized in that the calculation of the 

y^ortho 

desired orthogonalized boundary value « for the attribute a=pO comprises the following 
steps: 

a) Selecting all the attributes pi with i=l...g in the speech model that have a larger range RW 
20 than the attribute a=pO and include the latter; 

b) Calculating desired boundary values mpi for the attributes pi with i=0...g; 

c) Sorting the attributes pi with i= 0...g according to their RW; 

d) Selecting one of the attributes pi having the largest RW; 

e) Checking whether there are other attributes pk which include the attribute pi and have a 
25 larger RW than the selected attribute pi; 
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fl) If so, defining a parameter X as a linear combination of the orthogonalized boundary 

values ^ calculated in step g) during the last run of the steps e) to g) for all the attributes 
pk that have a larger range and are determined in the most recently run step e); 
f2) If not, defining the parameters X to X = 0; 

g) Calculating the desired orthogonalized boundary value ^ for the attribute pi by 
arithmetically combining the desired boundary value mpi with a parameter X; and 

h) Repeating the steps e) to g) for the attribute pi-1 whose RW is smaller than or equal to the 

^ ortho ortho 

RW of the attribute pi until the desired orthogonalized boundary value ^ with i=0 

has been calculated in step g), 

3. A method as claimed in claim 2, characterized in that the calculation of the 

parameter X in step fl) is made according to the following formula: 



k 



4. A method as claimed in claim 3, characterized in that the calculation of the 

desired orthogonalized boundary value ^' is made in step g) according to the following 
formula: 



20 ^'^^-X 



5. A method as claimed in claim 2, characterized in that the calculation of the 

desired boimdary values for the attributes pi with i= 0,...,g is made in step b) by 
respectively calculating the frequency N(pi), with which the attribute pi occurs in a training 
25 corpus and by subsequently smoothing the calculated frequency value N(pi). 



6. A method as claimed in claim 5, characterized in that the calculation of the 

frequency N(pi) is made by applying a binary attribute function fpi to the training corpus 
where fpi is defined as: 

30 
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1 1 if Pi fits in the word sequence (h, w) 
1 otherwise 0 



and where {h, w) indicates whether the attribute pi correctly describes a pattern predefined 
by the word sequence (h,w). 

7» A method as claimed in claim 1, characterized in that the mathematical 

^ortho 

function G has as a further variable the magnitude of a convergence step ^ with: 



. ortho 



K = yM 



ortho 



10 where 



/-ortho 
a 



Mortho: represents for binary functions ^ the maximum number of functions 
which yield the value 1 for the same argument (h,w). 

8. A method as claimed in claim 7, characterized in that the attribute function 

IT ortho jr 

15 -^"^ is cdculated by linearly combining an attribute function •'^ with orfhogonalized 

ortho 

attribute functions is calculated from attributes p that have a larger range than the 

attribute a. 



9. A method as claimed in claim 8, characterized in that the calculation of the 

T ortho 

20 orthogonalized attribute function -'^ for the attribute a=pO comprises the following steps: 

a) Selecting all the attributes pi with i=l ...g in the speech model that have a larger range RW 
than the attribute a=pO and include the latter; 

b) Calculating boundary values fpi for the attributes pi with i=0...g; 

c) Sorting the attributes pi with i= 0...g according to their RW; 
25 d) Selecting one of the attributes pi having the largest RW; 

e) Checking whether there are other attributes pk which include the attribute pi and have a 
larger RW than the selected attribute pi; 

fl) If so, defining a function F as a linear combination of the orthogonalized attribute 
function f^^"" calculated in step g) during the last run of the steps e) to g) for all the 
30 attributes pk that have a larger range determined in the most recently run step e); 
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f2) If not, defining the fiinction F to F = 0; 

g) Calculating the orthogonalized attribute function f^^"" for the attribute pi by 

arithmetically combining the attribute function fpi with the function F; and 

h) Repeating the steps e) to g) for the attribute pi-1 whose range is smaller than or equal to 
the range of the attribute pi until the orthogonalized attribute function r^^^'^f^"'^'' with i=0 
has been calculated in step g). 

10. A method as claimed in claim 9, characterized in that the calculation of the 

function F in step fl) is made according to the following formula: 



ortho 



11, A method as claimed in claim 9, characterized in that the calculation of the 

r- ortho 

orthogonalized attribute function ^ in step g) is made according to the following 
15 formula; 

12. A method as claimed in claim 1, characterized in that the mathematical 
20 fimction G has the following form: 



^rthoin+l) (j^^^^^^^^^^ fit'^^^^ ) 

Tf ortho y„ortho ,r -i Z-^"- / / r 

_jtorthoin) ^^ortho i Ug * "^a "^^g J r 

a or » ortho ^ortho{n) .z, t i V^r^or?/jo ^ ortho , t t 



where: 

25 a : refers to a just considered attribute; 

y : refers to all the attributes in the speech model; 
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^ortho ^ortho 



^ortho ^ortho jLrortnu 

: refer to the size of the convergence step with = ^ =1/ with 
M''"" = maxfS/r(/»,>v)' 



r ortho 



^ortho ^ ortho 



ortho 

where Mortho for binary functions represents the 

maximum number of functions which yield the value 1 for the same argument 

(h,w); 

: refers to desired orthogonalized boundary values in the MESM for 
the attributes a and y; 



^orthoin) ortho{n) 



n 10 



ba and by 



: refers to iterative approximate values for the desired boundary 

ortho(n) 

values m'f'%^r ;and 
: refer to constants. 



13. A method as claimed in claim 1, characterized in that the mathematical 

function has the following form: 



'^ortho(n+l) x-f/ ^orthoCn) ^ortho \ 



^Xorthoin)^^ortko ^.^^^ 



15 



m 



ortho 



m 



ortho(n) 



1- T^h-mJ"") 



20 



where: 
n 

Ai(n) 
a 



^ortho f ortho 



: represents the iteration parameter; 

: represents an attribute group Ai(n) with l<i<m selected in the n^ iteration 
step; 

: represents a just considered attribute from the just selected attribute group 
Ai(n); 

: represents all the attributes of the attribute group Ai(n); 

^ ortho ^ ortho \j- ortho 

: represents the size of a convergence step with « = ^ =1/ with 



rOrtho 



25 



M, , = max 
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ortho r ortho 

where '^"^ represents for binary functions ^ ^ the maximum 
number of functions from the attribute group Ai(n), which yield the 
value 1 for the same argument (h,w); 

^ortho ^ortho 

« , ^ : represent desired orthogonalized boundary values in the MESM for the 



attributes a and p respectively; 



ortho (n) ortho (m) 



: represent iterative approximate values for the desired boundary values 



^ortho n^ortho 



2 ortho 

1 0 where the selection of the group Ai(n) of attributes a, whose associated parameters « are 
f 3 adapted to a current iteration step is made either cyclically or according to a predefined 

J^": criterion. 

14. A speech recognition system (10) comprising: a recognition device (12) for 

•~ 35! 

^ ' 1 5 recognizing the semantic content of an acoustic signal captured and rendered available by a 
C3 microphone (20), more particularly a speech signal, by mapping parts of this signal onto 

predelBned recognition symbols as they are offered by the implemented maximum-entropy 
iy speech model MESM, and for generating output signals which represent the recognized 

ry semantic content; and a training system (14) for adapting the MESM to recurrent statistical 

20 patterns in the speech of a certain user of the speech recognition system (10); characterized in 

that the training system (14) calculates free parameters X in the MESM in accordance with 

the method as claimed in claim 1 . 



15. A training system (14) for adapting the maximimi-entropy speech model 

25 MESM in a speech recognition system (10) to recurrent statistical patterns in the speech of a 
certain user of this speech recognition system (10), characterized in that the training system 
(14) calculates free parameters X in the MESM in accordance with the method as claimed in 
claim 1 . 



